gr-qc/9705006 



THE STATISTICAL MECHANICS OF BLACK HOLE THERMODYNAMICS * 

Rafael D. Sorkin 

Instituto de Ciencias Nudeares, UNAM, A. Postal 70-543, D.F. 04510, Mexico 

and 

Department of Physics, Syracuse University, Syracuse, NY 13244-^^30, U.S.A. 

internet address: sorkin@suhep.syr.edu 

Abstract 

Although we have convincing evidence that a black hole bears an entropy 
proportional to its surface (horizon) area, the "statistical mechanical" ex- 
planation of this entropy remains unknown. Two basic questions in this 
connection are: what is the microscopic origin of the entropy, and why 
does the law of entropy increase continue to hold when the horizon en- 
tropy is included? After a review of some of the difficulties in answering 
these questions, I propose an explanation of the law of entropy increase 
which comes near to a proof in the context of the "semiclassical" approx- 
imation, and which also provides a proof in full quantum gravity under 
the assumption that the latter fulfills certain natural expectations, like 
the existence of a conserved energy definable at infinity. This expla- 
nation seems to require a fundamental spacetime discreteness in order 
for the entropy to be consistently finite, and I recall briefly some of the 
ideas for what the discreteness might be. If such ideas are right, then 
our knowledge of the horizon entropy will allow us to "count the atoms 
of spacetime" . 



When I first learned of the thermodynamics of black holes, and specifically of the 
fact that a black hole possesses an entropy proportional to its horizon area, my reaction 
(after thinking about it a while) was that this was just as if the horizon were divided 
into small "tiles" of a fixed size, with each tile carrying roughly one bit of information. 
To see that this would lead to the correct proportionality law, imagine a or 1 engraved 
on each tile. If there were A tiles, then the number of possible configurations would be 

* To appear in the Proceedings of the Chandra Symposium: "Black Holes and Rela- 
tivistic Stars", ed. R. M. Wald, held December, 1996, Chicago, (U. of Chicago Press). 
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iV = 2x2x2---x2 = 2, and the corresponding entropy would be 5" = log N = A log 2 
(taking Boltzmann's constant k equal to one). In order to get the numerical coefficient 
right, the tile size would have to be around 10~^^cm, that is, it would have to be of order 
unity in units with c = h = 8nG = 1. 

Of course no one believes (or would admit to believing) that the black hole horizon 
is painted with tiny O's and I's, but the suggestion remains that, in some less artificial 
manner, a cutoff occurs at around the Planck scale, and the microscopic degrees of 
freedom proper to the horizon carry about one bit of information per horizon "atom". 

In order for such an explanation to work, it would have to provide convincing answers to 
two principal questions: what degrees of freedom does this information capture (to what 
N is one really referring when one says S = k log A^) , and why does the total entropy still 
increase when black holes are involved (why does the Second Law of Thermodynamics 
continue to hold)? 

The explanation that would resolve these twin questions is what I mean by the 
"statistical mechanics behind black hole thermodynamics". We can hope that in the 
process of arriving at such an explanation, we will learn something important about the 
nature of spacetime on small scales, just as the quest for the statistical mechanics of a 
box of gas taught us something important about the nature of ordinary matter on atomic 
scales, revealing the existence of atoms, their sizes, and something about their structure 
and quantum nature. 

Equally, we may hope that the investigation of these questions will shed new light 
on statistical mechanics itself, and specifically on the meaning of entropy. For example, 
the experience so far has been that no derivation of the Second Law can even get started 
without first applying some form of coarse-graining to define the entropy, and the choice 
of coarse-graining seems to introduce an unwelcome element of subjectivity into the foun- 
dations of statistical mechanics. But a black hole affords an obvious objective way to 
coarse-grain, namely neglect whatever is inside the horizon. Or to take another exam- 
ple, it is the possibility of fluctuations in the entropy that distinguishes the statistical 
mechanical picture from the thermodynamical one, but in practice such fluctuations are 
ordinarily too small to be observable. With black holes, on the other hand, one can, at 
least in principle, arrange for arbitrarily large fluctuations to occur [1] . 
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Before we address the statistical mechanics of black holes as such, let me remind you 
very briefly of their thermodynamic properties in a little more detail. In a process like 
stellar collapse, a black hole is said to form when a region of spacetime develops from 
which signals can no longer escape. Within the context of classical General Relativity 
the subsequent occurrence of a singularity is then inevitable, but it is expected to form 
inside the black hole, so that it is hidden from the view of distant astronomers (see the 
discussion in [2]). 

The black hole's horizon H is by definition the three dimensional surface separating 
the interior of the black hole from its exterior. Formally, we have H = 9(pastX"'"), where 

(called "future null infinity") is defined as the set of ideal points at infinity at which 
outgoing light rays terminate. Thus the past of X"*" consists of all events that can send 
light rays to infinity; and H is its boundary. From this definition alone certain mathe- 
matical facts follow, including the fact that H is a, continuous surface (a manifold) 
which, although it may not be smooth (because of caustics), nevertheless is null almost 
everywhere in the sense that it is a union of null geodesies which never leave H as they 
propagate into the future. (These ruling geodesies are photon world lines that hover 
on the horizon, balanced precariously between escaping to infinity and being pulled into 
the singularity.) When we speak of the "area of the horizon", we mean the area of the 
cross-section in which H intersects some spacelike (or possibly null) hypersurface S on 
which we seek to evaluate the entropy: * 

A := Area{HnE). 



Now an abundance of evidence indicates that there is associated with an event hori- 
zon of this sort an entropy of 

Sbh = -p-, (1) 

where 

= SttGH (2) 

* For this definition of A to make sense, it is necessary that H HT, not be too rough. 
I don't know whether one can prove this for every possible black hole horizon H and 
smooth surface E, but "Geometric Measure Theory" guarantees at least that, for any 
given H, there exists a dense set of S's for which A is well defined [3]. 
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is the square of the "rationahzcd Planck length" . The best known piece of evidence for 
this association is that the black hole radiates in precisely the right manner to be in 
equilibrium with a surrounding gas of thermal radiation at the temperature derived from 
(1) via the First Law of Thermodynamics, dM = TdS (the Hawking radiation). But the 
evidence goes well beyond that, ranging from theorems in classical General Relativity 
that can be interpreted as the Zeroth through Third Laws of Thermodynamics applied 
to a black hole in the h limit, to computations directly yielding the entropy (1) in 
the "tree level" approximation of path-integral quantum gravity. 

Many of these relationships carry over to other spacetime dimensions and other 
gravity theories than standard General Relativity, as emphasized in [4]. However, the 
evidence remains less complete and convincing in these other cases. * In particular one 
still lacks an analog for these other cases of the result that in standard General Relativity 
represents the h limit of the Second Law of Thermodynamics, namely the theorem 
that classically the total horizon area necessarily increases (or remains constant) as the 
hypersurface E on which it is evaluated moves forward in time. Because of the way that 
h enters into the expressions (2) and (1), the black hole entropy goes to infinity in the 
classical limit, and so tends to dominate all other entropies. Therefore, this classical law 
of area increase can be interpreted as precisely what remains of the Second Law when 
% tends to zero. (Unfortunately, the proof of area increase remains incomplete even in 
standard General Relativity, because it rests on the still unproven assumption of "cosmic 
censorship".) 

Notice that the law of area increase, even though it is valid only in the non-quantum 
limit, is a fully nonequilibrium result in the sense that no requirement of stationarity 
is imposed on the black holes or the classical matter with which they interact. In the 
complementary limit of fully quantum matter interacting with a near equilibrium black 
hole, there exist several arguments and thought experiments suggesting the impossibility 
of procuring a decrease in the total entropy (black hole plus entropy of surroundings) 
by any process in which the black hole evolves quasi-stationarily and remains essentially 
classical. (Later, I will propose a completely general proof of this impossibility.) Taken 

* In a sense it is disappointing that black hole thermodynamics appears to be so robust: 
the less sensitive it is to the theoretical assumptions, the less capable of guiding us to the 
correct underlying theory of quantum gravity! 
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together, these resuhs in special cases strongly suggest that the Second Law of Thermo- 
dynamics, AS > 0, will continue to hold in general if we attribute to each black hole its 
corresponding entropy (1) and take for the total entropy, the sum of this horizon-area 
entropy with the entropy of whatever else may be present outside the black holes: 

Stot = Sbh + Soutside increases with time. (3) 

Remark The above discussion has defined a black hole in causal terms, and correspond- 
ingly has taken the horizon to be what is more precisely referred to as the event horizon. 
A rather different concept is that of apparent horizon, whose definition generalizes the 
curvature properties of the Schwarzschild horizon, rather than its causal properties. In 
application to time-independent black holes, the two concepts coincide, but away from 
equilibrium they differ. It has been proposed [5] to identify the area that enters into 
the formula (1) as the area of the apparent horizon rather than the event horizon. The 
apparent horizon has the apparent advantage of being definable "quasi-locally" , whereas 
locating the event horizon requires in principle a knowledge of the entire future of the 
spacetime. On the other hand, it is precisely this "teleological" attribute of the event 
horizon that gives rise to the large entropy fluctuations alluded to above. Moreover, the 
concept of event horizon seems more fundamental than that of apparent horizon, and 
therefore more robust in relation to possible discrete replacements for spacetime such as 
the causal set [6]. In addition, the area of the apparent horizon will often jump discon- 
tinuously, which is not how one might expect entropy to behave. For these reasons, I will 
stick with the identification, horizon = event horizon, but it seems prudent to bear the 
other alternative in mind as well. 

Now, how would we understand the nondecreasing character of Stot if a black hole 
were an ordinary, nonrelativistic thermodynamic object? For example, suppose the black 
hole were really a warm brick or, say, a hot ball of hafnium. In that case (recalling 
the familiar plausibility arguments, as nicely presented in [4]), we would identify Nbh 
(the subscripts stand for "ball of hafnium") as the number of internal micro-states of the 
ball, and Sbh = log Nbh as its logarithm. If we went on to assume that the ball was 
weakly coupled to its surroundings, then we could write (with Nout being the number of 
micro-states of the surroundings), 

Ntot = Nbh ■ Nout (4a) 
Stot = Sbh + Sout (4fe) 
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(On the other hand, if the coupHng was not weak, then the states of the two subsystems 
would not be able to vary independently, and so the estimate Ntot = Nbh ■ Nout would 
be inaccurate.) Under the further assumption that the dynamical evolution of the whole 
system was ergodic (exploring all of the available state-space) and unitary (so preserving 
state-space volume as measured by number of states), we would conclude that the time 
spent in any region of state-space was proportional to the number of states in that region: 

dwell time oc Ntot, (5) 

so that * the probability of a transition in which Nfot increased would be more likely 
than one in which it decreased, the discrepancy being overwhelming for large entropy 
differences because AS >> 1 =^ e'^'^ >>> 1. 

So what goes wrong with this reasoning if we try to apply it to a black hole? In 
the first place, it is at least peculiar that the number of black hole states would be 
proportional to e^^^^ rather than e^°^"™^ as for other thermodynamic systems. This 
peculiarity becomes more troubling if we consider the example of the Oppenheimer- 
Snyder spacetime, in which a Friedmann universe of arbitrary size is joined onto the 
interior of a Schwarzschild black hole of arbitrary mass. (See the remarks in [9].) The 

* The plausibility argument here could be made stronger if we assumed a form of "detailed 
balance" for the effective Markov process operating on the macro-states, or better "meso- 
states" (cf. [7]). Then it would follow immediately that the probability (per unit time, 
say) of a transition from state 1 to state 2, given that the system was currently in state 
1, would be greater by e'^^"'^^ than that of the reverse transition, given that the system 
was currently in state 2. 

It is interesting that such a Markovian model of the evolution appears easier to 
justify in a classical framework, where the system really is in a definite (albeit unknown) 
micro-state at any instant. In the quantum case, in contrast, there is no reason to believe 
that the state-vector normally lies within any particular eigensubspace of a macroscopic 
observable like the temperature distribution. Thus, although the definition of entropy 
works better in the quantum case (because "number of micro-states" really makes sense 
there) , the argument for its increase seems to proceed more happily in the classical setting. 
To recover a Markovian picture in the quantum case as well, one might have recourse to 
a sum-over-histories interpretation of the formalism, or to the closely related picture in 
which coarse-grained histories are obtained from sequences of projection operators as in 
[8]. 
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existence of such solutions means that the number of possible interior states for a black 
hole is really infinite, which is certainly not consistent with any formula like S — log N. 

A second set of problems concerns ergodicity and internal equilibrium. The course of 
events inside a collapsing star leads classically to a singularity, and it is not at all obvious 
that this is consistent with an ergodic exploration of all available states, including for 
example the Oppenheimer-Snyder states just described. But even if quantum effects did 
restore ergodicity, there would remain a problem with equilibrium. Although I did not 
stress it above, an assumption of internal equilibrium (or partial equilibrium) is needed in 
order to deduce the entropy from the values of a few macroscopic variables. For example, 
knowing only the surface temperature of the ball of hafnium would not at all allow you 
to deduce its entropy unless you added the assumption of internal equilibrium; if this 
assumption were mistaken, you might find the apparent entropy suddenly starting to 
decrease, because the interior of the ball was much colder than you had assumed. In the 
same way, mere knowledge of the external appearance of a black hole tells you little about 
its interior, and since realistic black holes would seem to be far from internal equilibrium, 
this is another reason to doubt whether the type of state-counting utilized in (4) and (5) 
can carry over to black holes with Nbh interpreted as the number of interior states. 

A related problem with such state-counting is that our earlier assumption of weak 
coupling between the subsystem and its environment is doubly wrong in the case of a black 
hole. The coupling from outside to inside is not weak but very strong, while the reverse 
coupling is not so much weak as nonexistent! Indeed this last observation points up the 
fact that conditions in the interior should be irrelevant, almost by definition, to what goes 
on outside. And since the Second Law, as ordinarily formulated for black holes, makes 
no reference to conditions inside, it seems especially strange that it should have anything 
to do with counting interior states. (In contrast, the temperature distribution inside our 
ball of hafnium can make a big difference in its interaction with the outside world, as 
we have seen, and it is impossible to specify its entropy without saying something about 
the internal conditions, if not explicitly, then implicitly via the assumption of internal 
equilibrium.) 

Finally there is the vexed question of unitarity. Many people refer to this in terms of 
an "information puzzle" , the puzzle being that the facts apparently belie their belief that 
there must be a well-defined unitary S-matrix for the exterior region alone; but for our 
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purposes here, the existence of such an S-matrix is irrelevant, because all we are interested 
in is the Second Law, and that certainly imposes no such requirement. * Rather, what 
the ordinary statistical mechanical reasoning requires is overall unitarity (for exterior and 
interior regions together), and the difficulty lies in combining this overall unitarity with 
the mode of explanation that would locate the entropy of the black hole in the multiplicity 
of its interior micro-states. If the latter were correct, then a contradiction with unitarity 
would arise in the process of evaporation of a black hole by Hawking radiation. In fact, 
since the black hole loses entropy as it shrinks (its surface area decreases), its number of 
internal states would have to go down as well, and at some point there would no longer be 
enough of them to support the correlations with the radiated particles which are needed 
if the overall evolution is to remain unitary. 

At least this conclusion is inevitable if we accept the semiclassical description of 
the radiation as consisting of correlated pairs A and A, the first of which goes off to 
infinity while the second falls into the singularity. In this approximation of quantum field 
theory on a fixed, background black hole metric, the emitted particles A taken alone are 
described by a highly impure state of the exterior field, and the unitarity of the overall 
quantum evolution is restored only when the A ^ A correlations are taken into account. 
(One sometimes says that the particles A are "entangled" with the particles ^4.) 

In order for these entanglement correlations to exist, however, it is necessary that 
the interior of the black hole support a quantum state-space of dimension at least e^'^"-'^ , 
where Srad is the entropy of the emitted thermal radiation. If the number of internal 
states really diminished as the black hole shrank then this would cease to be possible, and 
so unitarity could be maintained only if the A ^ A correlations were transferred to ones 
of the form A ^ B between emitted particles. Ultimately, if the black hole were allowed 
to evaporate fully, then all of the A A correlations would have to be transferred to the 
outside; and thus unitary evolution of the whole system, together with the assumption 
that black hole entropy counts the number of internal states, would require the external 
evolution alone to be unitary, at least in the ^-matrix sense. 

* On the contrary, a unitary evolution of the exterior region would be inimical to the 
type of explanation of the Second Law I will propose below. 
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Now, it is possible to imagine mechanisms by which the required A ^ B correlations 
could arise, but it is much less easy to imagine how the A ^ A correlations could dis- 
appear, since they arise in an approximation which should remain good in full quantum 
gravity. But if they don't disappear then the quantum state would have to stay "entan- 
gled" , which in turn would require the number of internal states to remain much larger 
than allowed by the formula (1). Hence one has either to abandon the interpretation 
of black hole entropy in terms of internal states or to grant that the overall quantum 
evolution of the system, black hole -|- environment, is nonunitary (or both). 

Despite the seeming inevitability of this conclusion, many workers still hope to evade 
it, but in seeking to do so, they are driven to rather desperate maneuvers, such as 
hypothesizing a new "complementarity" according to which the internal state-space would 
be of a different dimensionality for observers outside the black hole than for observers 
inside of it. Such conceptual difficulties notwithstanding, the attempt to imagine how the 
external region alone can possess a unitary S'-matrix (or perhaps even a dynamics which 
remains unitary during all intermediate stages) has led to some interesting suggestions, 
including the suggestion [10] that at very small distances the only variables that remain 
are purely geometrical ones, with all other distinctions (color, flavor, generation, etc.) 
being washed out. 

By far the greatest effort toward providing a unitary statistical mechanics for black 
hole thermodynamics has been exerted within the context of string theory (which is not 
to say that strings are necessarily tied to a unitary explanation, any more than any other 
approach is, cf. [11]). In fact most of the effort has been directed to only one of the two 
questions I emphasized at the outset, namely the question of what degrees of freedom one 
must count in order to obtain the formula (1). The earliest calculation of this sort that I 
know of was performed by Steve Carlip [12] for a black hole in 2+1 dimensional gravity. 
Although this calculation did not actually use a stringy version of gravity, it used string 
technology to count certain "gauge" degrees of freedom defined on the horizon, obtaining 
(1) with precisely the thermodynamically required coefficient. This would tend to agree 
with the suggestion that the entropy is localized at the horizon, rather than inside the 
black hole. More recently, some calculations in string theory proper have also obtained 
equation (1) for zero temperature black holes in certain higher dimensional theories of 
gravity coupled to special combinations of gauge fields chosen to make supersymmetric 
solutions possible. These more recent calculations do not actually work with black holes. 
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rather they count certain "membrane" states in a flat-space Umit and obtain a formula 
which can be interpreted as the analytic continuation of (1) to that limit. (See [13] for a 
review of this work.) 

To the extent that the physical picture behind these stringy calculations can be 
extrapolated from flat spacetime to genuine black hole geometries (which assumes in 
particular that the "phase-transition" accompanying the formation of the horizon would 
not interfere with analyticity), they suggest that the degrees of freedom contributing 
to the entropy are associated with certain types of membranes. In contrast to Carlip's 
calculation, they also could be taken to suggest that the relevant degrees of freedom are 
those of the black hole as a whole (as opposed to being localized at the horizon), but since 
there are no horizons in flat space, such a suggestion would have to be very tentative at 
best. Beyond this, the stringy calculations do not (as far as I can see) shed much light on 
the question that to me is most central about the entropy of black holes: why is it flnite at 
all? We will see later that certain identiflable contributions to the entropy that arguably 
must be present are inflnite in the absence of a short-distance cutoff at the horizon. One 
might ask whether these contributions are present in the string theory picture, and if so, 
how the requisite cutoff arises. 

Concerning the derivation of the Second Law and the objections raised above, string 
theory apparently has little to say. If, at the end of the day, it is able to produce a unitary 
dynamics underlying quantum gravity, and if it is able to count the states of a black hole 
in this framework (and also explain why a weak coupling, equilibrium approximation is 
really valid after all, etc.), then the derivation of the Second Law will be reduced to the 
discussion one can flnd in any thoughtful textbook on statistical mechanics. However, we 
have seen that the demand for unitarity in particular, seems to drive one to a new kind 
of inside-outside complementarity that so far no one knows how to formulate. For this 
reason it seems impossible at this stage to address the question of the Second Law within 
the conflnes of any unitary theory that identifles the black hole entropy with the states 
of the black hole taken as a whole. Let us return, then, to our two main questions — 
"Why does S increase?" and "What does S count?" — and consider them in the order 
just given, hoping that an answer to the flrst will suggest an answer to the second. 
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Why does S increase? 

What I want to describe now is an old proposal [14] [15] that would derive the Second 
Law by appealing directly to the property of black holes that makes them different from 
all other objects, the fact that what goes on outside the horizon takes place without any 
reference to what goes on inside. Classically this independence is exact, and quantum 
mechanically it can still be expected to hold to an excellent approximation, despite some 
quantum blurring of the horizon. But if the exterior region really has a well-defined 
autonomous dynamics, then it is particularly natural to "coarse-grain away" the interior 
region and seek to identify the entropy that enters into the Second Law with the entropy 
of some effective quantum density-operator describing the exterior situation. * 

More specifically, what we would like to do is evaluate the entropy on a hypersurface 
S like that discussed earlier, but with the difference that our new S terminates where it 
meets the horizon. We would like to associate an effective density-operator p (S) with 
each such hypersurface and to prove that 

5(S") > 5(S') 

whenever S" lies wholly to the future of S'. We will see, in fact, that this approach to 
the question leads to two proofs of entropy increase, a more fully worked out one which 
applies in the semiclassical approximation [15] (cf. the remarks in [16] and the related 
remarks in [17] and [18]), and a more sketchy one which applies in full quantum gravity 
[14] [15]. It also leads to the conclusions that the entropy is localized (to the extent that 
entropy can ever be localized) at or just outside the horizon [14] [19] [16], and that S 
owes its finiteness to a fundamental spacetime discreteness or "atomicity" [14] [19]. 

Let us take first the case of a quasi-classical, quasi-stationary black hole, by which 
I mean that we ignore quantum fluctuations in M and the other black hole parameters 

* This is not meant to imply that on philosophical grounds, we must neglect the in- 
terior region because "we" cannot observe it. Rather my attitude would be that any 
coarse-graining at all is valid if it leads to a useful definition of entropy. The horizon is 
nevertheless special in this connection because, as we will see, its special causal proper- 
ties make it possible to draw conclusions that could not be drawn with other types of 
coarse- graining. 
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and we assume that the spacetime geometry can be well approximated at any stage by a 
strictly stationary metric. [In other words, we work in the framework of "quantum field 
theory in curved spacetime". Notice that the requirement of approximate stationarity 
applies only to the metric; the matter-fields (among which we may include gravitons) can 
be doing anything they like.] In such a situation there exists for the matter fields outside 
the black hole a unique thermal (or "KMS") state known as the "Hartle-Hawking 
state" and expressible as 

P ° oc e-^^ (6) 

where E represents the energy operator for the matter fields in the external region and P 
is the reciprocal of the thermodynamic temperature of the black hole. * (For simplicity, 
we may as well work with a nonrotating, charge-free black hole. Alternatively, one could 
just reinterpret E as E — uJ — (j)Q.) 

Now let us limit our consideration of the entropy to the hypersurfaces E(t) of a 
foliation of the exterior region which is compatible with the Killing vector field that 
expresses the stationarity of the metric. In other words, the E(t) are the t = constant 
surfaces of some coordinate system for which the metric is explicitly time-independent. 
(Notice, however, that it would not be appropriate to take t to be the Schwarzschild time 
coordinate, for example, since then the cross-section T,{t) f] H would not move forward 
along the horizon as t increased.) To each hypersurface S(t) there corresponds a quantum 
Hilbert space in which the field operators residing on S(t) are represented (in particular 
the operator E = E{t) of eq. (6)), and in which the quantum state p (t) can therefore be 
represented as a density operator. By identifying appropriately the hypersurfaces S(t) 
with one another (the natural identification here being that induced by the Killing vector 
^°'), we identify their attached Hilbert spaces, and the dynamical change of pit) with 
time becomes thereby a motion of p{t) within a single Hilbert space. (Notice that this 
evolution of p is well defined because the boundary H at which we have truncated the 
hypersurfaces S is an event horizon, across which no information can propagate. This 



* This expression is inevitably not rigorous, if only because the theory of (interacting) 
quantum fields is itself not rigorous. A related comment is that, in a nonstationary 
background, there would be difficulties with the definition of E, even in the case of a free 
field, as Adam Heifer pointed out to me after my lecture [20]. 
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property of autonomous evolution would be lost if, say, H were replaced by a timelike 
surface, or if we tried to evolve p(t) backward in time.) 

Now the key feature of the state (6) for us is that it is time-independent — as every 
equilibrium state must be by definition. What makes this so important is that given 
any well-defined {hut not necessarily unitary) evolution law for density-operators p (t), 
and given any state p° that is stationary with respect to this evolution, we can find 
a function /(p (t)), defined for arbitrary states pit), which is nondecreasing with time. 
(More precisely, this is true classically for an arbitrary Markov process, and true quantum 
mechanically under a certain auxiliary technical assumption.) In effect, every state "wants 
to evolve toward the stationary one" , and / is a kind of Lyapunov functional measuring 
how close p (t) has come to p^. Now, when the stationary state has the Gibbsian form 
(6), the quantity /(p) turns out to be (up to an additive constant) 

S{p)-(5<E>= trp(logp-^-/3E); (7) 

that is, it turns out to be the free energy up to a factor of — 1/T. 

The proof of this little known result is so remarkably simple (at least classically) that 
I cannot resist presenting it here, in the important special case where /3 = 0. To begin 
with, note that the function fix) = x\n.x~^ is concave downward since fix) = —1/x < 
in the range < a; < 1. Now consider a Markov process whose probability of being in 
the k^^ state at some moment of time is pk- The quantity (7), when /? = 0, is nothing 
but the entropy 

k k 

so what we have to prove is that Sip) increases when the pk get replaced at some later 
time by Tkipi, Tki being the matrix of transition probabilities. But we have 

sip) = Y.fM 

k 

k I 

>J2^kifiPi) 

kl 

I 



13 



where to get the inequahty, we used the concavity of / together with the fact that 



because T preserves (when /3 = 0) the totaUy random state, = 1; and in the last step 
we used that 

k 

(conservation of probability). When the stationary state is not uniform, the proof is 
almost as simple, only S gets replaced by 

Y.PkfMk), 

k 

which for a thermal = e~^^'' is just 

J^Pk^ log ^ = J2pk{-(3Ek - Inpk) = S-/3<E>, 
^ Pk Pk ^ 

which is indeed the classical form of (7). 

Returning to the black hole situation, it is now simple to see that the nondecreasing 
character of (7) entails that of the total entropy in our semiclassical, quasistationary 
approximation. To that end, consider the small change of state that occurs as the hyper- 
surface E' moves slightly forward in time to E", and write now Sout for the entropy 5'(p) 
of the exterior matter, in order to distinguish it from the entropy Sbh of the black hole 
itself. For the latter we have (from the "First Law of black hole thermodynamics" ) that 

dSsH^PdM, (8) 

M being the mass of the hole. As part of the semiclassical approximation, we also assume 
that the mass of the black hole adjusts itself in response to the quantum mechanical 
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expectation value of the energy it exchanges with the matter fields. Therefore (changing 
to ^Eout for notational consistency) we have* 

< Eout > = constant, (9) 

whence dM = —d < Eout > and dSsH = —f^ d < Egut >■ Putting this together with the 
fact that the expression (7) must not decrease in the process (and observing that /? in 
that expression represents a fixed parameter of the stationary metric) , we can write for 
the infinitesimal change E' — > S", 

d{Sout - P < Eout >) > 
dSout -Pd< Eout > > 
dSout + dSsH > 

d{Sout+SBH) > (10) 



Thus we have proved the Second Law in the semiclassical approximation, for arbi- 
trary processes in which the black hole geometry changes sufficiently slowly. This class 
of situations includes all that I know of for which thought experiments have been done 
to check the Second Law (see [4] for some of them); however it does not cover black holes 
that are far from equilibrium, for example ones just formed by the coalescence of two 
neutron stars and still in the process of settling down to a stationary state. Notice also 
that in this proof we are not deriving the value of the horizon entropy, but only showing 
that the Second Law holds if we use the value (1) provided by thermodynamic arguments. 

Finally, it should be added that the matter entropy S{p) we have been working with 
is actually infinite, due to the entanglement between values of the quantum fields just 

* One might worry that the two terms in this equation refer to two difi^erent energies, M 
to the total energy as defined at infinity, and < £^ > to an energy defined with respect to 
the stationary background geometry. That this is not really a problem can be seen, for 
example, by imagining an infinitesimal mass m falling into the black hole from infinity. 
On one hand, this augments the mass M of the black hole by m; on the other hand, 
by conservation of the conserved energy current T^^^ in the stationary background, the 
exterior energy Egut decreases by the same amount m as the mass passes through the 
horizon. A more direct proof that (classically) dSsH = —PdEout may be extracted from 
the derivation following eq. (13) in the first reference of [21]. 
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inside and just outside the horizon. In a httle while we will consider this near- horizon 
entanglement entropy as a possible source of the black hole entropy itself, but for now it is 
just a nuisance since the divergence in Sout means that (7) diverges as well. Thus, making 
our proof rigorous would require showing that changes in (7) are nevertheless well-defined 
and conform to the temporal monotonicity we derived for that quantity. This probably 
could be done by introducing a high-frequency cutoff on the Hilbert space (using as high a 
frequency as needed in any given situation) and showing that the evolution of p remained 
unaffected because the high-frequency modes remained unexcited. * 

To what extent can we expect to generalize these considerations to the case of greatest 
interest, that of a fully dynamical, quantum black hole (or holes)? In one respect, the 
situation actually simplifies, because the technical hypothesis of complete positivity is no 
longer needed. The complication, of course, is that the continued validity of some of our 
other assumptions will depend on the structure of the quantum gravity theory in which 
the proof is to be realized. Without knowing that structure in advance we can do no 
better than to list the features that would be needed in order for the proof to go through. 
In writing down this list, I will assume that the hypersurfaces E to which the entropy is 
being referred can be specified by some generally covariant prescription that continues to 
make sense in quantum gravity, at least in some sufficiently great subset of the situations 
for which we would want to formulate a Second Law. (For example, we might take 
advantage of the fact that a "box" is needed in order for thermodynamic equilibrium to 
be possible, and specify E as the boundary of the future of a freely chosen cross-section of 
the box, regarded as a timelike "world tube" of fixed geometry. [More precisely, E would 
be that part of the boundary lying inside of the box and outside of any future horizons 

* Alternatively, perhaps one could show that the additive constant, — log tre"'^^, omit- 
ted from (7) canceled the divergence in a well-defined sense. In order to make the proof 
rigorous, one would also have, for example, to specify an observable algebra for the ex- 
terior fields and a representation of that algebra in which the operators p and E were 
well-defined (which in particular might raise the issue of boundary conditions near the 
horizon). In addition, one would have to prove that the autonomous evolution of p was 
"completely positive", this being a condition for the applicability of the theorem that 
guarantees the nondecreasing nature of (7) in the quantum case. This probably could 
be done by expressing the autonomous evolution as a unitary transformation followed 
by a tracing out of interior degrees of freedom. See [15] for references and some further 
discussion of these points. 
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that were present.] Such a E would be "achronal", though not strictly spacelike, and 
the temporal relationship of two E's specified in this way would follow directly from that 
of their cross-sections.) With respect to some such family of hypersurfaces the needed 
assumptions are these: 

• there is defined a Hilbert space and for each surface E, an effective density- 
operator p (E) acting in Ti , 

• p evolves autonomously in the sense that p (E") is determined by p (E') whenever 
E" lies to the future of E' , 

• there exists an operator E defined at the boundary of the system (or in any case 
without direct reference to the region inside the black hole) and yielding the total 
conserved energy, 

• the operator p^^ = 9{Eq — E) is preserved by the autonomous evolution, 

• (VE'o) dim(7ig^^^) < oo, where Ti-^^^^ is the subspace of Ti. with total energy less 
than £'0. 

Depending on your expectations, hopes or fears for quantum gravity, you may find 
different ones of these assumptions more or less plausible or palatable. For me all are at 
least plausible, albeit the entire framework of Hilbert space and operator observables is 
unlikely to be reproduced in an exact form in quantum gravity. In any case, if we accept 
these assumptions, then it follows easily that the quantity 

S'tot = trp logp"^ (11) 

is a nondecreasing function of E. (The underlying mathematical theorem is proved in [22] 
and also in [15], where some further discussion of the above assumptions may be found as 
well.) This, then, will establish the Second Law (3) if we can show in addition that Stot 
is a sum of two terms, one associated with the horizon and one with the exterior region. 

Why is 5 a sum? 

So why would Stot = trp logp ~^ take the form of the sum A/ 1'^ -\- S surroundings when 
p describes the exterior state including all fields, both gravitational and nongravitational? 
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For this to occur, there would need to be a great many degrees of freedom just outside or 
"contained in" the horizon (one might expect it to be thickened due to quantum effects) , 
making their own identifiable contribution to Stot- And of course this contribution would 
have to be proportional to the horizon area in order to agree with equation (1). Three 
ideas that have been proposed for what the horizon degrees of freedom might be are: 

(a) the geometrical shape of the horizon itself, 

(b) the modes of quantum fields propagating just outside the horizon, 

(c) the fundamental degrees of freedom of the substratum, 

where by "substratum", I mean the underlying structure (s) of whatever turns out to 
be the true theory of quantum gravity. Of course these possibilities are not necessarily 
exclusive of each other. All three types of contribution might be present, and they might 
also overlap significantly (for example, substratum degrees of freedom might show up 
in an effective description as geometrical variables describing the horizon shape). In 
concluding this article, I would like to say a few words about each of these possibilities 
and how they bear on the question of spacetime discreteness. 

An attractive feature of the first proposal [14] [23] is that it offers a geometrical 
explanation for the very geometrical relationship (1). Unfortunately, it is not easy to 
estimate the magnitude of the quantum fiuctuations in the horizon shape, but there are 
indications [21] that they become significant, not at the Planck scale I (as one might have 
expected), but at the much larger scale Aq ~ (MZ^)^/^. Such fiuctuations would in effect 
spread the horizon into a shell of thickness Aq harboring a potentially unlimited source 
of entropy. In fact, the density of fiuctuation modes diverges as their transverse wave- 
number goes to infinity. This means that, without any cutoff, the entropy residing in 
the shape degrees of freedom would presumably be infinite. On the other hand, the very 
rapidity of the modes' growth rate also means that most of the modes with wavelength 
greater than any specified lower bound Xmin have A ~ A^j^. In consequence, a result 
like (1), (2) emerges automatically (at least in crudely estimated order of magnitude) if 
one does assume a cutoff of magnitude Xmin ~ I- 

The second proposal leads to very similar conclusions. Here, if we work in the 
approximation of a fixed background geometry, and if we limit ourselves to free quantum 
fields, then we can actually compute the entropy Sout = — trp log p of the field, and we 
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obtain [14] [23] the result S ~ A/X^-^ where Xmin is the cutoff. In this case, we recognize 
the area law explicitly, and we see again that we must choose Xmin ^ I in order to recover 
an entropy of the correct order of magnitude. 

Unlike for proposal (a) , where the effect of shape fluctuations on the density operator 
p (E) is not completely clear, a contribution of type (b) must necessarily be present in the 
entropy (11). In conjunction with the type (a) contribution, this leads to an argument 
for the inevitability of spacetime discreteness: under the assumption of a true continuum, 
the type (b) entropy could fail to be infinite only if it provided its own cutoff by inducing, 
and thereby coupling to, horizon fluctuations of type (a), but then these would take over 
and provide an entropy that therefore would still be inflnite. * 

Another facet of proposal (b) which should be mentioned here is the apparent dif- 
flculty that, since each fleld makes its own contribution, the black hole entropy would 
seem to depend on the number of species of fundamental flelds in nature. However, this 
conclusion is inevitable only if we ignore the coupling of fleld fluctuations to horizon 
shape and also hold flxed the value of the cutoff Xmin- But at flxed cutoff, not only S 
but also the Planck length (2) will be affected by the addition of a new species, and it 
appears [25] that this dependence is just what is needed to maintain the relationship (1) 
unchanged. 

Of course the need for a cutoff bespeaks an underlying spacetime discreteness, and so, 
to my mind, the most intriguing possibilities of type (c) are those in which the substratum 
has a discrete character. In such a theory one could hope to derive the entropy, not just 
by counting discrete quantum states of physically continuous variables, but by counting 
certain discrete physical elements themselves (compare the fact that the entropy of a 
box of gas is, up to a logarithmic factor, just the number of molecules it contains). For 
example, in causal set theory, one might count the number of causal links crossing the 
horizon (near E), or in canonical quantum gravity in the loop representation, one might 
count the number of loops cut by the horizon (within S). In any such case, the result 
would be something like the horizon area in units set by the fundamental discreteness 
scale. Thus, to reduce the evaluation of the entropy (1) to a counting exercise of this 
sort would be to open up a direct path to learning the value of the fundamental length. 

* For a partly different interpretation see [24] . 
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And if that were to occur, then the quest for the statistical mechanics of black hole 
thermodynamics would certainly have led us to something of interest: it would have led 
us to the atoms of spacetime itself. 
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